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Abstract — We are interested in how to best communicate a 
(usually real valued) source to a number of destinations (sinks) 
over a network with capacity constraints in a collective fidelity 
metric over all the sinks, a problem which we call joint network- 
source coding. Unlike the lossless network coding problem, lossy 
reconstruction of the source at the sinks is permitted. We make a 
first attempt to characterize the set of all distortions achievable 
by a set of sinks in a given network. While the entire region 
of all achievable distortions remains largely an open problem, 
we find a large, non-trivial subset of it using ideas in multiple 
description coding. The achievable region is derived over all 
balanced multiple-description codes and over all network Hows, 
while the network nodes are allowed to forward and duplicate 
data packets. 

I. Introduction 
A. Joint Network-Source Coding: Problem Formulation 

Joint network-source coding (JNSC) is the problem of com- 
municating and reconstructing a (usually real valued) source 
in a network to a maximal collective fidelity over a given 
set of sinks, while the flows of the code streams satisfy the 
edge capacities of the network. JNSC can be considered as a 
lossy version of the (lossless) network coding problem, since 
the reconstruction is not necessarily perfect. The source is 
"observed" by a subset of nodes in the network, called source 
nodes. Due to capacity constraints, source nodes have to com- 
municate a coded version of the source to their neighboring 
nodes. Just as in lossless networked coding, intermediate nodes 
can in general transcode data received from other nodes, and 
communicate it to their neighbors. Any node in the network, 
based on the information it receives about the source, can 
reconstruct the source with some distortion. This paper aims 
to characterize the set of distortions simultaneously achievable 
at a pre-specified subset of nodes (sinks) in the network. 

Unlike its lossless counterpart, the interaction of lossy 
source-network codes with arbitrary networks is largely un- 
explored. In fact, the term network coding refers, almost 
exclusively, to lossless network communication. This is despite 
the fact that arguably the majority of applications, both in the 
Internet and in various wireless setups, involve lossy source 
communication, in particular for multimedia applications. It 
should however be noted that some of the well studied exam- 
ples of multi-terminal source coding problems (e.g., multiple- 
description coding) are simple examples of a general lossy 
networked coding problem. 

In this paper the network model is similar to, now standard, 
models in network coding [1]. The JNSC problem is defined 



by the following elements: 

(1) A directed graph G(V,E). 

(2) A function R : E M+ that assigns a capacity R{e) to 
each link e E E. We normalize bandwidth with the source 
bandwidth, therefore, R{e) is expressed in units of bits per 
source symbol. 

(3) A source X in some alphabet F and a set of distortion 
measures p" : F" M+. We assume X admits a rate- 
distortion function Dx{R), with p as the measure. 

(4) Two sets 5, T C V that denote the set of source and sink 
nodes respectively. The source nodes observe, encode, and 
communicate X in the network. Source nodes are assumed 
to be able to collaborate in encoding. This can model, for 
example, computer networks where sources are encoded off- 
line and copies of the code are distributed to the source nodes. 

Nodes can communicate with neighbor nodes at a rate 
specified by the capacity of the corresponding link. The goal 
is to communicate the source X from the source nodes in 
S, and reconstruct X at the sink nodes in T. A distortion 
vector d = (dt,t G T) € M'"^' is said to be achievable if 
X can be reconstructed with a maximum distortion of dt at 
a sink node t by using a coding scheme that respects the 
capacity constraints on the links, i.e., the rate of information 
per source sample communicated over e is less than R{e). As 
in [1], we need to leave the details of the code unspecified, 
because it proves extremely hard to come up with the most 
general class of possible codes. An intriguing problem is how 
to characterize the set of all achievable distortion <-tuples 
VxiG,S,T,R) C MI^I. Note that this problem includes the 
usual lossless network coding problem if the source alphabet 
F is finite and the distortion measure is defined so that 
B") = if and only if A" = S". 

B. Multiple-Descriptions: a Tool for JNSC 

Multiple-description codes (MDC) have always been asso- 
ciated with robust networked communications, because they 
are designed to exploit the path and server diversities of a 
network. The present active research on MDC is driven by 
growing demands for real-time multimedia communications 
over packet-switched lossy networks, like the Internet. With 
MDC, a source signal is encoded into a number of code 
streams called descriptions, and transmitted from one or more 
source nodes to one or more destinations in a network. An 
approximation to the source can be reconstructed from any 
subset of these descriptions. If some of the descriptions are 
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Fig. 1 . An example of flow of a two description code. 

lost, the source can still be approximated by those received. 
This is why there seems to be a form of consensus in the 
literature in that multiple description codes should only be 
used in applications involving packet loss, because only in 
this case the overhead in the communication volume can be 
justified. 

This paper shows, however, that MDC is beneficial for lossy 
communication even in networks where aU communication 
links are error free with no packet loss. In this case, multiple 
description coding, aided by optimized routing, can improve 
the overall rate-distortion performance by exploiting various 
paths to different nodes in the network. This can be easily 
demonstrated through an example. In Fig. ^ a source node 
(node 1) feeds a coded source into a network of four sink 
nodes (nodes 2-5). The goal is to have the best reconstruction 
of the source at each of these four nodes. All link capacities are 
C bits per source symbol. MDC encodes the source into two 
descriptions (shown by solid and dashed boxes in the figure), 
each of rate C. Descriptions 1 and 2 are sent to nodes 2 and 3 
respectively. Node 2 in turn sends a copy of description 1 to 
nodes 4 and 5, while node 3 also sends a copy of description 
2 to nodes 4 and 5. In the end, nodes 4 and 5 will each receive 
both descriptions, while nodes 2 and 3 will only receive one 
description. 

To see how the nodes in the network benefit from MDC, 
let £'i(C), £'2(C'), Di2(C) be the distortion in reconstruct- 
ing the source given description 1 or 2 or both. Let d = 
{d2,d^,di,dc,) be the vector of the average distortions in 
reconstructing the source at nodes 2 through 5. Therefore, 
d = i?2(C), D^2[C), DMC))- 

Let's define Dm as the set of all achievable distortion 4- 
tuples d. Although MDC is in general a special form of lossy 
networked coding, Vm still contains a large and interesting 
subset of all achievable distortion tuples. In this example, 
it includes for instance, the distortion region achievable by 
separate source and networked coding. By results in [1], 
the maximum rate with which common information can be 
communicated to nodes 2 through 5 is C bits per source 
symbol. Therefore, the distortion rate achievable by separate 
source and network coding is Vs — {(<52, (52, 1^4, ^5) : > 
2-^^,1 = 2,3,4,5}. We immediately have that Vs C Vm 
by noting that Di{C) = 1)2 (C) = 1)12 (C) = 2'"^^ is part of 
Dm- In fact this corresponds to communicating two identical 
descriptions, each of which is an optimal (in the rate-distortion 
sense) source code of rate C for X. 

The inefficiency of separate source and network coding 
lies in that even through nodes 4, 5 have twice the incoming 



capacity compared to nodes 2, 3, their reconstruction error 
(di = ds) is bounded by the reconstruction error of the weaker 
nodes (^2 = ^3)- Unlike lossless coding, lossy codes can 
play a tradeoff between the reconstruction errors at different 
nodes, generating a much larger set of achievable distortion 
tuples d than Vs- These tradeoffs are essential in practice. 
For instance, in networked multimedia applications over the 
Internet, where the network consists of a set of heterogenous 
nodes, the experience of a user with broadband connection 
should not be bounded by that of a user with a lesser 
bandwidth. Such tradeoffs are perhaps best treated as an 
optimization problem by introducing appropriate Lagrangian 
multipliers (or weighting functions). An objective function to 
minimize, therefore, can be defined as 

d(p,d)=p^d (1) 

where p = [P2,P3,P4,P5] is an appropriate weighting vector 
An optimal solution will be given by: 

d*(p) = arg min d{p,d) 
deVM 

Once the optimal distortion vector d* is found, one should, 
in principle, be able to find a multiple description code that 
provides the marginal and joint distortions corresponding to 
d*(p) (such an MDC exists). 

As a concrete example, let's optimize the average distortion 
at all nodes 2 through 5 in Fig.[T]for p = [1/4, 1/4, 1/4, 1/4], 
in which case: 

^ ^ 2D,2iC) + D^jC) + D2iC) 

To be specific, lets assume that the source in question is an iid 
Gaussian with variance one for which achiveable distortions in 
multiple description coding are completely derived by Ozarow 
in [2]. The symmetry in indices 1 and 2 ensures that (|2ji is 
minimized when the two descriptions are balanced, that is, 
Di{C) = D2{C) = D. Ozarow's result, when specialized to 
balanced MDC states that the following set of distortions are 
achievable: 

Di = D2^D> 2"2C (3) 

2-4C 

" {D + y/W^^2^){2 -D- VD^ - 2-4^^ 

The average distortion in (|2j can therefore be minimized 
under the constraints of (|3}. This is a particularly easy task 
because the region Q is convex. Let this optimal average 
distortion be d^(C). By separating source from network 
coding, the reconstruction distortion at nodes 2 through 5 (and 
hence the average distortion over all these nodes) is at best 
dsiC) = 2~2'^. It is easy to show that ^^/(C) < ds(C) for 
all C > 0. In other words, for all C > there exists a balanced 
two description code for which the average distortion over all 
sink nodes is strictly less than the average distortion achievable 
by any separate source and network coding scheme. 
A number of important observations are due: 
. MDC routing can exploit path diversity in ways that a 
separate source and network coding can not. For instance, in 
the example of Fig. Q, nodes 4 and 5 can benefit from the 
data received both from nodes 2 and 3, while nodes 2 and 3 
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themselves can benefit from the data they relay, which was not 
possible if a common data was communicated to both nodes 
2 and 3 by the source node. 

. To benefit from MDC in the network, routing needs to be 
optimized. 

. Not only the routing, but also the MDC should be designed 
optimally. In our example, we did this by choosing an MDC 
with desired side and joint distortions to minimize the average 
distortion (|2j. In other words, while any distortion pair satis- 
fying Q is achievable by some MDC, only one pair [D, D12) 
(corresponding to a particular MDC design) can minimize (|3}- 
. Unlike the case of minimizing Q, optimizing the MDC 
may result in a different number of, potentially unbalanced, 
descriptions. In general, the total number of descriptions and 
their rates are left as optimization parameters. 

In this paper, by confining ourselves to balanced MDC 
codes of the same rate, we will be able to find a practically 
interesting, achievable distortion region for the JNSC problem. 
In Section (jnji we introduce both discrete and continuous 
versions of a new routing problem, called rainbow network 
flow, which plays an integral role in JNSC. We then state our 
main achievability results which are proved in Section (IIIH . 

II. Rainbow Network Flow Problem 

The ideas in the previous section are formalized into the 
concept of Rainbow Network Flow (RNF). RNF is concerned 
with routing and duplication of balanced MDC description 
packets in an arbitrary network and the subset of descriptions 
received by sink nodes. RNF for balanced descriptions of the 
same rate is posed in the following setting: 

(1) G{V,E), a directed graph with a node set V and an edge 
set E. 

(2) S = {si,S2,...,s\s\},T = {ti,t2,t3,...,tiT\} two 
subsets of V representing the set of source and sink nodes 
respectively. 

(3) A function R : E ^ M+ representing the capacity of each 
link in G. 

(4) A set X C M called the description set. 

(5) An r e R+ called the description rate. 

(6) jjL : V{x) li^, a measure on where V{x) denotes 
the set of all subsets of x- 

A flow path from sG^toteTisa sequence of edges 
w{s,t) = [(wo = s,wi), (t;i,t)2), (wm-i,i'm = t)], such 
that (wi, Wi+i) G E for i = 0, 1, m — 1. 

A rainbow network flow (RNF), denoted by 
0(0, T, 5, X, J", W^, /), consists of a set W of flow paths 
in G, and a so-called flow coloring function f : W ^ x- 
For the RNF in Fig. [T] W = {[(1, 2), (2, 4)], [(1, 2), (2, 5)], 
[(1,3), (3,4)], [(1,3), (3,5)]}, and the flow coloring function 
/ assigns /([(1, 2), (2, 4)]) = 1, /([(1, 2), (2, 5)]) = 1, 
/([(1,3),(3,4)]) = 2, /([(1,3),(3,5)]) = 2. 

The rainbow network flow problem is said to be discrete 
(dRNF) if X C N and fj.{M) = r\M\ where | • | is the 
cardinality of a finite set. The example in Fig. corresponds 
to a dRNF with x = {1, 2}, r = C, 5 = {1}, T = {2, 3, 4, 5}, 
R{e) = C for aU e e E. 



The rainbow network flow problem is said to be continuous 
(cRNF) if X is the Borel algebra on R and /i = /is is the 
Borel measure. The parameter r becomes irrelevant in cRNF 

Throughout the paper, we will liberally drop the arguments 
when they are obvious from the context or are not relevant to 
the formulation at hand. 

Let ^E{e,W) and $y(w,M^) be the sets of all col- 
ored flow paths in W that contain the link e or the 
node V, respectively. For example, $£;(e = {1,2),W) = 
{[(1,2),(2,3)],[(1,2),(2,5)]}. 

The spectrum of an edge e ^ E, with respect to RNF a, is 
defined as: 

^Eia,e)= U fiw) 

Likewise, the spectrum of a node v is defined as: 

*v(a,w)= IJ f{w) 

In Fig. □ for instance *£;((1,2)) = *£;((2,4)) = 
^-£((2,5)) - {1} and, *b((1,3)) = *b((3,4)) = 
^'£;((3, 5)) = {2}. The spectrum of the nodes 4,5 consists 
of both descriptions (i.e., {1,2}), while the spectrum of the 
nodes 2, 3 is {!}, {2} respectively. 

An RNF a{G, R, W, /) is said to be admissible with capac- 
ity function R, if and only if: 

Ai(*£;(a,e)) < i?(e) e E (4) 

The significance of this inequality is that it allows for 
duplication of a description by relay nodes. Therefore, two 
flow paths of the same color can pass through a link e, and 
yet consume a bandwidth of only r. 

The RNF plotted in Fig. [2 is admissible because at most 
one description with rate C is communicated over each link 
and the capacity of each link is C. This is made possible by 
duplicating at nodes 2,3. 

Let T{G, R) be the set of all admissible RNF's in G with 
capacity function R. Any RNF a e ^{G, R) results in an 
admissible rainbow flow vector (RFV), q(a) {qt;t ^T) e 
RI'^I, such that: 

qt= ^Ii'^v{a,t)) (5) 

In Fig.[nfor instance, the depicted flow results in an RFV q = 
C(l, 1, 2, 2) (i.e., nodes 2,3 receive one description and nodes 
4,5 receive two). Fig. |2] depicts an example of an admissible 
cRNF. The spectrum of the nodes 6,7,8 are: ^'^(ue) = 
(0.5, 2) U (3, 4), *y(v7) = (2, 2.5), and *y(v8) = (1, 1-5) U 
(2, 2.5) which results in an RFV of q (1.5, 0.5, 2.5). 
Let Q(G, R) C RI^I be the set of afl admissible RFV's: 

Q(G,i?)= y q(a) 

III. Achievability Results 

To proceed we need a way of parameterizing the family 
of MDC's that are generated by the well-known technique of 
Priority Encoding Transmission (PET). 

Let Ti, be the set of all functions y : x ~* such that 
/ ydfj. = 1. For dRNF, in particular, the set H = H is the 
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Fig. 2. Example of an admissible cRNF: The capacity of the edges are 
2,1,0.5 which is proportional to the thickness of the line. Node 1 is a source 
and nodes 6,7,8 are sinks. On each edge, the subset of the real line that is 
routed over that edge is shown. 

set of all discrete vectors y = {iji/.i = 1,2, |xl) such that 
S'i'i Vi — 1- Poi" cRNF, Ti consists of all functions y such 
that Jp°° y[r)dr = 1. 

We can show that there is a one to one correspondence 
between the members of set ?i and the multiple description 
codes generated by the PET technique. Furthermore, the 
reconstruction distortion at each sink node can be calculated 
given the RFV q and a function y E H. 

For any J/ e 7Y, g e Q{G,R), define the |r|-tuple real 
valued vector d = {dt;t £ T) such that; 



dt{y,q) = Dx ^ 



fi{x)y{x)dfj. 



where Dx{ ) is the distortion-rate function of the source X. 
For dRNF, d = d(y, q) = (d^; i e T) e MI'^I such that: 



<lt/r 

dt{y,q) = Dx ( r^iy{i) 



(6) 



Note that for dRNF qt jr is an integer equal to the number 
of distinct descriptions node t received. Let B{G^ r, x) C K'-'"! 
be the union of all such vectors d, that is, 

6(G,r,x)= U d(y,q). 

yen,qeQ(GM) 

It should be evident by now that for dRNF, B{G,r, \x\) 
depends only on the cardinality of the set x and not the actual 
set of descriptions. 



Likewise for cRNF, the vector d = d(y, q) = {dt;t E T) 
is defined such that: 

dt{y,q) = Dx (^J xy{x)dx^ (7) 

Also, we define B{G) C K'^' to be the union of all d{y, q) 
over y e 7i and qe Q{G,R). 

The following is our main theorem. 

Theorem 3.1: B{G) C Vx{G, S, T, R). 

Here, B{G) represents a large class of achievable distortion 
vectors for the JNSC problem. To prove theorem 13.11 we 
need to establish a series of theorems and lemmas. The first 
step is to establish the achievability result for the discrete 
version of the problem. 

Theorem 3.2: B{G,r,\x\) C Vx{G,R,S,T) for all 
r e M+ and X C N. 

Proof: The achievability is a direct consequence of our 
construction. In particular any achievable RFV q — {qt,i £ 
T), defined in (IIII> . indicates that qt/r distinct descriptions 
each of rate r can be communicated to sink nodes t E T. To 
find the reconstruction distortion at a node t £ T using this 
MDC, we would need to know the exact subset of x that is 
present at t. However, qt/r only specifies the total number of 
the distinct descriptions received and not the exact subset of 
the descriptions. That is why we need to assume that the MDC 
is balanced, that is, for any < fc < the source can be 
reconstructed to the same fidelity given any subset of size k 
out of the total of |x| descriptions. In this case, knowing the 
total number of distinct descriptions available at t G T (i.e., 
qt/r) suffices to find the reconstruction distortion at t. 

For producing balanced MDC, we use a popular method 
called Priority Encoding Transmission (PET), with which any 
number of balanced multiple descriptions can be produced 
from a progressively encoded source stream. The idea is the 
following. To make |x| balanced descriptions each of rate r 
bits per source symbol, for a large enough value of n, encode 
n samples of X into a progressive bitstream (feo7 bnrL), 
where we have assumed n • r is an integer for simplicity. Let 
K = Ixl- Then take an K ■ n ■ r binary matrix and call 
it y = [Yij,i = 1,2, ...,K,j = 1,2, ...,n ■ r]. Now take 
y = {yi,i = 1, 2, K), any vector of real numbers of length 
K such that X^ili 2/' ~ 1- Now, for i = 1,2,. ..,K do the 
following: let Yi,Y/ for I = 1,2, K be sub-matrices of Y 
consisting of: 

i-i I 
Yi = \Yi] ; i = l:l, j = ^n ■ ryu -.^'i 

k=l k=l 



ryk\ 



Y{ = [F/ ; i^l + l:K, j = ^ n • ryfc : ^ n • ryu] 

fc=l k=l 

Therefore, matrix Yi will contain i x n ■ r x yi bits while 
y/ has {K ~ i) X n ■ r X yi bits. For i = 1,2, K, put the 
i X n ■ r X yi bits of the progressive source code stream , from 

bg{i) to feg(j)+jxn-rxy, 1" Y^, whcrc g{i) = J2k=i kxn- ry^. 
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In Yl on the other hand, put parity symbols of a [i ■ n ■ r ■ 
Hi, K ■ n ■ r ■ Hi) ideal erasure correction code corresponding 
to the bits in Yi. 

Now the descriptions consist of the K columns of the 
matrix Y, each of n • r bits. The total source bits used is 
n ■ rY^^-i kyk- It is easily verified that given any I < K 
descriptions, the first = X]fe=i k ■ n ■ r ■ yk bits of the 
source bitstream can be recovered. For large enough n and 
assuming the source is progressively refinable, given any k 
distinct descriptions, the source can therefore be reconstructed 
within distortion: 

Dxiik/n) ^ Dx (^rJ2ly}j (8) 

We denote this choice of MDC hy U{y, r, \x\,X). Any non- 
negative vector y, such that X]l=i Hi = ^ therefore specifies a 
valid U {y, r, K, X) code and vice versa. Theorem l3.2l is now 
easily proved by comparing (|8j and (|6|l. ■ 

Then we show that the achievable region for dRNF will 
converge to that for cRNF as stated by the following theorem. 

Theorem 3.3: Vr > and x C N, 

B{G,r,\x\)cB{G,r,^)cB{G) 

and moreover, \imr^o+ B{G,r,lg/r\) = B{G) for some 
constant g depending on G, R only. 

Theorem 13.11 follows directly from Theorems 13.31 and 13.21 
The proof of Theorem 13.31 is essentially based on two facts, 
(1) any cRNF can be approximated arbitrarily closely by a 
dRNF with small enough packet size r and, (2) reducing the 
packet size r dose not decrease the achievable region of dRNF. 
In the remaining of this paper, we will put forward the main 
lemmas required for proving Theorem l3.3l Unfortunately, due 
to lack of space, the details of some of these lemmas have to 
be published elsewhere. 

First, we need to show that increasing the number of de- 
scriptions can only increase the achievable region. Therefore, 
in dRNF, there is no harm in letting the set x to be the whole 
integers N. 

Lemma 3.4: For all r e M+ if X > isT' G N then: 
B{G, r, K') C B{G, r, K) C B{G, r, oo). 

Proof: Take d any member of B{G, r, K) which corre- 
sponds to some U {y, r,K,X) and a flow vector q S Q{G, R). 
Trivially, for K' > K, the flow vector q remains achievable. 
Define U{y',r,K',X) such that = yij = 1,2,..., K 
and y'l — Q,l — K + 1, K' . The distortion vector S' G 
B°{G,r,X,K') corresponds to U{y',r,K',X) and the flow 
vector q' is therefore equal to q, proving the assertion. ■ 

Next, we show that by dividing the rate of the descriptions 
r by an integer number i, and multiplying the total number 
of descriptions by i, the set of achievable distortions can only 
increase. 

Lemma 3.5: For any integers K,i ^ 'N and real number 
r > 0, one has B{G, r, K) C B{G, r/i, i.K) C B{G, r/i, oo). 

Proof: Note that any flow path w can be split into i 
flows, each of rate r/i. Any admissible flow therefore, will 



still remain admissible. Now, expand the set x to a set x' 
such that Ix'l = i\x\- To each member of x, we can therefore 
assign i distinct members of x' ■ For ^ny admissible flow 
vector therefore, q e Q{G, R) and for any integer i, there 
exists an admissible flow vector q' e Q{G, r/i, iL) such that 
q[ — Qt. Now let d be a distortion vector corresponding to 
q and U{y, r, K, X). Then define U'{y' , r/i, iL, X), such that 
y'ik — Uk for all fc = 1,2, ...,K and we let y'f., ~ for all 
k' not divisible by i. The distortion vector d' corresponding 
to U'{y' , r/i, iK, X) and q is therefore equal to 5. Therefore, 
any distortion vector 5 E B{G, r, K) is equal to a distortion 
vector d' in B{G,r/i,X,i.K) which proves the assertion. 

The last part follows from Lemma J3.4> . that is, allowing for 
more number of descriptions will not decrease the achievable 
distortion region. ■ 

For any r, therefore, the largest achievable region will occur 
when i goes to infinity, or the size of the descriptions r/i 
goes to zero. This however, does not necessarily mean that 
the limit limr^o+ B{G, r, oo) exists. In fact, B{G, r, K) is not 
necessarily continuous for all r > 0. Take for example the 
extreme case where the size of the description r is equal to 
the maximum outgoing capacity of all source nodes. Then, 
no description packet is able to leave any source. When r 
is slightly decreased however, it might be possible to have 
a single description flow and therefore the set of achievable 
distortions can jump discontinuously. As the description size 
becomes smaller, however, this discontinuity becomes less and 
less significant. The following lemma formalizes this. 

Lemma 3.6: Take any r' < r and a d' g B{G, r' , oo). Then 
there exists a d e B{G,r, oo) such that Vi € T, \dt - d[\ < 
7 • r for some constant 7 > depending only on the network 
topology. 

Proof: Let d' G B{G,r' ,00) correspond to a flow 
vector q' and an MDC U {y, r' , 00, X). Now if the size of the 
descriptions where increased from r' to r > r' , the measure of 
the spectrum at every edge e (seelllH should be multiplied by 
at most |^'£;(a, e)| x {r/r'). This of course might render the 
flow infeasible because some of the conditions in () are not 
satisfied any more. For any such overloaded edge, we delete 
some of the flows randomly until the capacity constraint on 
the edge is respected. 

We know that a total spectrum of |\E'E(a, e)| using descrip- 
tions of rate r' can flow through e. When we replace these 
descriptions with descriptions of rate r > r', we can keep 
at least [|^£;(a, e)/r|J of these flow paths, that correspond 
to distinct descriptions. The total spectrum of e therefore is 
at least (|5'£;(a, e)|/r — 1) x r = e)| — r. In other 

words, there is a flow with descriptions of rate r that respects 
the capacity on the edges e and does not decrease the total 
spectrum of e by more than r. 

Now replacing flows of rate r' with flows of rate r > r' 
for edge e might also disrespect the constraint on other edges. 
For each such edge, however, we can repeat the procedure, 
that is replacing all the flows with rate r' with flows of rate r 
and then deleting extra flows until the capacity on that edge 
is respected. Since there are at most edges, after replacing 
all the flows with flows of rate r and deleting excess flows, 
the total reduction in the overall flow is at most r x \E\'^. 



Now for any U{y,r' ,00, X), a distortion vector d'{S^;t e 
T) is obtained. Replacing the old flow with this new flow, a 
new distortion vector d — [St;t ^ T] can be achieved such 
that 



r\E[ 




Zx\E\'r + o{r) 



where in the last inequality we have used the fact that Dx(-) 
is differentiable with a bounded derivative and Zx is a 
constant depending on the function Dx and 7 = 
is independent of r. ■ 
The following lemma can therefore be proved: 

Lemma 3.7: Take any countable sequence ri,r2,... of 
positive numbers, such that lim^^oo = 0. Then, 
U„^(G,r„, Ll^^lV^nJ) converges to 8(0). 

Proof: Using ( 13. 6> . one can show that 
{J^B{G,r„,l\E\'^/rn\) converges to a unique B*{G) 
regardless of the sequence r„. Now note that the cRNF routes 
subsets of a Borel cj-algebra. As such, each flow in cRNF 
with finite Borel measure can be approximated arbitrarily 
closely with a collection of discrete flows, each of rate r„ 
provided that lim„^oo — 0. One can use this to show that 
the Hmit B*{G) is in fact equal to B{G) of cRNF. The details 
of the proof are omitted due to space limit. ■ 
Theorem l3.3l is a direct consequence of Lemmas 13.71 Together, 
Theorems 13.21 and 13 . 3 1 lead to Theorem 13. II 
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